Deterministic Complexity and Entropy

نویسندگان

  • Mark R. Titchener
  • Radu Nicolescu
  • Ludwig Staiger
  • T. Aaron Gulliver
  • Ulrich Speidel
چکیده

Lempel and Ziv (1976) proposed a computable string production-complexity. In this paper, our emphasis is on providing the rigorous development, where possible, for the theoretical aspects of a more recent and contrasting measure of string complexity. We derive expressions for complexity bounds subject to certain constraints. We derive an analytic approximation to the upper bound to linearize the complexity measure. The linearized measure enables us to propose an entropy measure, observed elsewhere to correspond closely with the Kolmogorov-Sinai entropy in simple dynamical systems.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Entropy and the Complexity of Graphs Revisited

This paper presents a taxonomy and overview of approaches to the measurement of graph and network complexity. The taxonomy distinguishes between deterministic (e.g., Kolmogorov complexity) and probabilistic approaches with a view to placing entropy-based probabilistic measurement in context. Entropy-based measurement is the main focus of the paper. Relationships between the different entropy fu...

متن کامل

Topological Entropy of Formal Languages

In this thesis we will introduce topological automata and the topological entropy of a topological automaton, which is the topological entropy of the dynamical system contained in the automaton. We will use these notions to define a measure of complexity for formal languages. We assign to every language the topological entropy of the unique minimal topological automaton accepting it. We contrib...

متن کامل

On Nonlinear Complexity and Shannon's Entropy of Finite Length Random Sequences

Pseudorandom binary sequences have important uses in many fields, such as spread spectrum communications, statistical sampling and cryptography. There are two kinds of method in evaluating the properties of sequences, one is based on the probability measure, and the other is based on the deterministic complexity measures. However, the relationship between these two methods still remains an inte...

متن کامل

Evolution of Information and Complexity in an Ever-Expanding Universe

Using the usual definitions of information and entropy in quantum gravity and statistical mechanics and the existing views about the relation between information and complexity, we examine the evolution of complexity in an ever expanding universe.

متن کامل

A New Approach to Detect Congestive Heart Failure Using Symbolic Dynamics Analysis of Electrocardiogram Signal

The aim of this study is to show that the measures derived from Electrocardiogram (ECG) signals many a time perform better than the same measures obtained from heart rate (HR) signals. A comparison was made to investigate how far the nonlinear symbolic dynamics approach helps to characterize the nonlinear properties of ECG signals and HR signals, and thereby discriminate between normal and cong...

متن کامل

Measuring communication complexity using instance complexity with oracles

We establish a connection between non-deterministic communication complexity and instance complexity, a measure of information based on algorithmic entropy. Let x, y and Y1(x) be respectively the input known by Alice, the input known by Bob, and the set of all values of y such that f(x, y) = 1; a string is a witness of the non-deterministic communication protocol iff it is a program p that “cor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Fundam. Inform.

دوره 64  شماره 

صفحات  -

تاریخ انتشار 2005